Gospel Translations:Technology/Multi-wiki project - Revision history

Mahra at 17:41, 3 September 2008

2008-09-03T17:41:07Z

← Older revision		Revision as of 17:41, 3 September 2008
Line 3:		Line 3:
	===Description===		===Description===
	=====Goal=====		=====Goal=====
-	to have a separate wiki for every language we support, with fully automated content loading and updating	+	To have a separate wiki for every language we support, with fully automated content loading and updating. For an example of a final product, see [http://es.gospeltranslations.org the test Spanish wiki].

	=====Requirements=====		=====Requirements=====
Line 13:		Line 13:
	===== Currently working =====		===== Currently working =====

-	~~This is one process that could be used to accomplish the multi-wiki setup and updates.~~ There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.	+	There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.
	# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])		# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])
	# <font color="orange">[quirky, but working]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])		# <font color="orange">[quirky, but working]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])
-	## reads ~~local PHP array to find all entries~~ for ~~language ''X''~~	+	## reads wiki page for CSV-style data, which tells what pages to create
	## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')		## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')
	## for each entry, creates a page on the target wiki, i.e., http://fr.gospeltranslations.org/wiki/ENTRY_TRANSLATED_TITLE		## for each entry, creates a page on the target wiki, i.e., http://fr.gospeltranslations.org/wiki/ENTRY_TRANSLATED_TITLE
Line 24:		Line 24:

	===== Still needed =====		===== Still needed =====
-	# '''Multiple wiki support.''' Right now this wiki relies on the account settings in basic_bot.php, which are wiki specific. The code should be upgraded so that the user can run the script once and it will update multiple wikis.	+	# <font color="red">[unassigned]</font> '''Multiple wiki support.''' Right now this wiki relies on the account settings in basic_bot.php, which are wiki specific. The code should be upgraded so that the user can run the script once and it will update multiple wikis.
-	# '''Data gathering.''' Currently the user has to first populate a wiki page with CSV-style data (see [http://es.gospeltranslations.org/wiki/~~Usario~~:TransBot test wiki page] for a messy example) telling the bot where to go and what to do. The bot should be able to automatically gather this information for each language from the English wiki.	+	# <font color="red">[unassigned]</font> '''Data gathering.''' Currently the user has to first populate a wiki page with CSV-style data (see [http://es.gospeltranslations.org/wiki/Usuario:TransBot test wiki page] for a messy example) telling the bot where to go and what to do. The bot should be able to automatically gather this information for each language from the English wiki.
-	# '''Page moving.''' The script should check a wiki for outdated pages (perhaps using the "last edited" date) and delete them. This will be necessary if the title of an article is re-translated, in which case the page for that article will need to move to its new title.	+	# <font color="red">[unassigned]</font> '''Page moving.''' The script should check a wiki for outdated pages (perhaps using the "last edited" date) and delete them. This will be necessary if the title of an article is re-translated, in which case the page for that article will need to move to its new title.
-	# '''Category management.''' Once a wiki is populated with articles, the categories on that wiki will need to be updated. The current script does not support that.	+	# <font color="red">[unassigned]</font> '''Category management.''' Once a wiki is populated with articles, the categories on that wiki will need to be updated. The current script does not support that.


	[[Category:Tech admin]]		[[Category:Tech admin]]

Mahra: /* Idea #1 */

2008-09-03T17:27:29Z

Idea #1

← Older revision		Revision as of 17:27, 3 September 2008
Line 11:		Line 11:

	===Technical process===		===Technical process===
-	===== ~~Idea #1~~ =====	+	===== Currently working =====

	This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.		This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.
	# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])		# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])
-	# <font color="orange">[quirky]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])	+	# <font color="orange">[quirky, but working]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])
	## reads local PHP array to find all entries for language ''X''		## reads local PHP array to find all entries for language ''X''
	## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')		## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')
Line 23:		Line 23:
	# <font color="green">[working]</font> Non-English wiki uses transclusion code to pull article text from English wiki. For example, the code <code><nowiki>{{:gt_en:Gospel_Implications/es}}</nowiki></code> will grab the entire article text from [[Gospel_Implications/es]]		# <font color="green">[working]</font> Non-English wiki uses transclusion code to pull article text from English wiki. For example, the code <code><nowiki>{{:gt_en:Gospel_Implications/es}}</nowiki></code> will grab the entire article text from [[Gospel_Implications/es]]

-	~~Obviously~~, what ~~is missing~~ from the ~~functionality right now~~ is a ~~working automation bot~~.	+	===== Still needed =====
		+	# '''Multiple wiki support.''' Right now this wiki relies on the account settings in basic_bot.php, which are wiki specific. The code should be upgraded so that the user can run the script once and it will update multiple wikis.
		+	# '''Data gathering.''' Currently the user has to first populate a wiki page with CSV-style data (see [http://es.gospeltranslations.org/wiki/Usario:TransBot test wiki page] for a messy example) telling the bot where to go and what to do. The bot should be able to automatically gather this information for each language from the English wiki.
		+	# '''Page moving.''' The script should check a wiki for outdated pages (perhaps using the "last edited" date) and delete them. This will be necessary if the title of an article is re-translated, in which case the page for that article will need to move to its new title.
		+	# '''Category management.''' Once a wiki is populated with articles, the categories on that wiki will need to be updated. The current script does not support that.
		+

	[[Category:Tech admin]]		[[Category:Tech admin]]

Mahra at 21:17, 2 September 2008

2008-09-02T21:17:32Z

← Older revision		Revision as of 21:17, 2 September 2008
Line 15:		Line 15:
	This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.		This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.
	# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])		# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])
-	# <font color="orange">[~~unassigned~~]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])	+	# <font color="orange">[quirky]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])
	## reads local PHP array to find all entries for language ''X''		## reads local PHP array to find all entries for language ''X''
	## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')		## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')
	## for each entry, creates a page on the target wiki, i.e., http://fr.gospeltranslations.org/wiki/ENTRY_TRANSLATED_TITLE		## for each entry, creates a page on the target wiki, i.e., http://fr.gospeltranslations.org/wiki/ENTRY_TRANSLATED_TITLE
	## on each page created, writes in transclusion code: <code><nowiki>{{:gt_en:ENTRY_ENGLISH_NAME}}</nowiki></code>		## on each page created, writes in transclusion code: <code><nowiki>{{:gt_en:ENTRY_ENGLISH_NAME}}</nowiki></code>
		+	## bot code: [[GospelTranslations:Technology/Multi-wiki_project/trans_bot.php\|trans_bot.php]]<br> bot framework: [[GospelTranslations:Technology/Multi-wiki_project/basic_bot.php\|basic_bot.php]]
	# <font color="green">[working]</font> Non-English wiki uses transclusion code to pull article text from English wiki. For example, the code <code><nowiki>{{:gt_en:Gospel_Implications/es}}</nowiki></code> will grab the entire article text from [[Gospel_Implications/es]]		# <font color="green">[working]</font> Non-English wiki uses transclusion code to pull article text from English wiki. For example, the code <code><nowiki>{{:gt_en:Gospel_Implications/es}}</nowiki></code> will grab the entire article text from [[Gospel_Implications/es]]

Mahra at 18:59, 26 August 2008

2008-08-26T18:59:22Z

← Older revision		Revision as of 18:59, 26 August 2008
Line 2:		Line 2:

	===Description===		===Description===
-	~~'''~~Goal~~:'''~~ to have a separate wiki for every language we support, with fully automated content loading and updating	+	=====Goal=====
		+	to have a separate wiki for every language we support, with fully automated content loading and updating

-	~~'''~~Requirements~~:'''~~	+	=====Requirements=====
	* Code base written in PHP		* Code base written in PHP
	* For each language ''X'', copy over every ''X'' article from this English wiki to a target wiki, http://''X''.gospeltranslations.org		* For each language ''X'', copy over every ''X'' article from this English wiki to a target wiki, http://''X''.gospeltranslations.org

-	~~'''~~Technical process - Idea #1~~'''~~	+
		+	===Technical process===
		+	===== Idea #1 =====

	This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.		This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.

Mahra at 18:57, 26 August 2008

2008-08-26T18:57:51Z

← Older revision		Revision as of 18:57, 26 August 2008
Line 8:		Line 8:
	* For each language ''X'', copy over every ''X'' article from this English wiki to a target wiki, http://''X''.gospeltranslations.org		* For each language ''X'', copy over every ''X'' article from this English wiki to a target wiki, http://''X''.gospeltranslations.org

-	'''Technical process'''	+	'''Technical process - Idea #1'''

	This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.		This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.

Mahra at 18:57, 26 August 2008

2008-08-26T18:57:21Z

← Older revision		Revision as of 18:57, 26 August 2008
Line 10:		Line 10:
	'''Technical process'''		'''Technical process'''

-	This is ~~the basic~~ process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.	+	This is one process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.
	# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])		# <font color="green">[working]</font> Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure\|see structure]])
	# <font color="orange">[unassigned]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])		# <font color="orange">[unassigned]</font> Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])

Mahra at 18:56, 26 August 2008

2008-08-26T18:56:00Z

← Older revision		Revision as of 18:56, 26 August 2008
Line 2:		Line 2:

	===Description===		===Description===
-	'''Goal:''' to have a separate wiki for every language we support	+	'''Goal:''' to have a separate wiki for every language we support, with fully automated content loading and updating

	'''Requirements:'''		'''Requirements:'''

Mahra at 21:35, 25 August 2008

2008-08-25T21:35:25Z

← Older revision		Revision as of 21:35, 25 August 2008
Line 1:		Line 1:
		+	Read on to learn more. Use the discussion tab to make comments, post solutions, etc.
		+
		+	===Description===
	'''Goal:''' to have a separate wiki for every language we support		'''Goal:''' to have a separate wiki for every language we support

Mahra: New page: '''Goal:''' to have a separate wiki for every language we support '''Requirements:''' * Code base written in PHP * For each language ''X'', copy over every ''X'' article from this Englis...

2008-08-25T21:26:30Z

New page: '''Goal:''' to have a separate wiki for every language we support '''Requirements:''' * Code base written in PHP * For each language ''X'', copy over every ''X'' article from this Englis...

New page

'''Goal:''' to have a separate wiki for every language we support

'''Requirements:'''
* Code base written in PHP
* For each language ''X'', copy over every ''X'' article from this English wiki to a target wiki, http://''X''.gospeltranslations.org

'''Technical process'''

This is the basic process that could be used to accomplish the multi-wiki setup and updates. There are some underlying techniques not spelled out here, so feel free to ask questions if something isn't connecting for you.
# [working] Cronjob imports up-to-date info DabbleDB database and stores it in local PHP array ([[Project:Technology/DabbleDB_export_structure|see structure]])
# [unassigned] Automating bot ([http://wikisum.com/w/User:Adam/Creating_MediaWiki_bots_in_PHP how to make one])
## reads local PHP array to find all entries for language ''X''
## for each entry, gets translated title off of the English wiki (i.e., for [[Gospel_Implications/es]], it finds the title ''Consecuencias del evangelio'')
## for each entry, creates a page on the target wiki, i.e., http://fr.gospeltranslations.org/wiki/ENTRY_TRANSLATED_TITLE
## on each page created, writes in transclusion code: <code><nowiki>{{:gt_en:ENTRY_ENGLISH_NAME}}</nowiki></code>
# [working] Non-English wiki uses transclusion code to pull article text from English wiki. For example, the code <code><nowiki>{{:gt_en:Gospel_Implications/es}}</nowiki></code> will grab the entire article text from [[Gospel_Implications/es]]

Obviously, what is missing from the functionality right now is a working automation bot.

[[Category:Tech admin]]